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DESIGN OF MODEL -FOLLOWING CONTROL SYSTEMS 
By Heinz Erzberger 
Ames Research Center 


SUMMARY 


This study gives an analysis of and offers design criteria for three con- 
figurations of model following. The three configurations studied are real 
model following, implicit model following or matching dynamics, and real model 
following with command inputs. It is assumed that model and plant are 
described by linear vector differential equations where the equations of the 
model may be of lower order than those of the plant. Algebraic tests are 
developed to determine under what conditions a feedback law exists that per- 
mits perfect following of the model by the closed-loop plant. The same set of 
tests is shown to be applicable to both real and implicit model following. 

This leads to the conclusion that real and implicit model following, although 
physically different, are mathematically equivalent if no unknown state distur- 
bances or parameter variations occur during the control interval. However, 
the condition for perfect following with command inputs to the model contains 
an additional test not present in the first two configurations. If perfect 
following has been shown to be possible, the control law that achieves it is 
calculated for the implicit model -following configuration. In the general 
case, this control law must generate both finite and impulse controls if the 
model is of lower order than the plant. A simple method of approximating the 
impulse control law to arbitrary accuracy is also given. The theory is 
illustrated with three examples, two of which are based on the lateral equation 
of motion of an aircraft. 


INTRODUCTION 


A model-following control system comprises two main components , the plant 
and the model. For instance, the plant is represented by the equations of 
motion of a particular aircraft and the model by the equations of motion of 
another aircraft having some especially desirable flight characteristic or 
handling quality. This paper is not concerned with the problem of selecting a 
model, but assumes at the outset that a model has already been specified. In 
the most general terms, the designer of a model-following control system is 
faced with the following problem: Given the differential equations describing 

the plant and the model, choose a feedback law around the plant so that the 
output variables of the plant, as a function of time, will faithfully follow 
the output variables of the model. 

Recently, Ellert and Merriam (ref. l) and Tyler (ref. 2) used quadratic 
optimal control to synthesize model -following control systems. Their 



technique, unlike those based on classical procedures, is applicable to arbi- 
trary multivariable systems and always yields a feedback configuration that 
min imi zes a quadratic function of the error between the plant output and the 
model. 

Although the application of optimal control theory to the synthesis of 
model -following systems was a great step forward, experience has brought to 
light some additional design problems for which the methods of optimal control 
alone prove computationally inefficient and conceptually unenlightening. An 
example of such a problem is that of deciding when the closed-loop plant can 
follow the model perfectly. That is, for a particular combination of plant 
and model, one may find that the closed -loop plant designed by the methods of 
optimal control follows the model with unacceptably large errors that cannot be 
reduced below some limiting value merely by manipulating the weight matrices 
in the cost function. Stated in another way, in a particular problem there 
may not be enough degrees of freedom in selecting the feedback matrix to match 
the plant to the model if the model dynamics differ greatly from the plant 
dynamics. In this case, as always, the feedback matrix calculated via optimal 
control still yields a weighted least -squares match between model and plant 
response during the control period, but gives no prior indication of matching 
accuracy, which must be determined separately either by actually checking the 
response of the closed-loop system or by evaluating the minimum cost. 

Another problem that optimal control can solve only Indirectly is that of 
deciding if the requirement of perfect matching of plant and model response 
entails a feedback matrix, some or all of whose elements asymptotically 
approach infinity. To answer this question by optimal control, one observes 
the elements of the optimum feedback matrix in response to a stepwise reduc- 
tion of the weight on the control vector in the quadratic cost function until 
a conclusion about the asymptotic behavior of the elements can be drawn. 

Despite its obvious inefficiency, this procedure, based on repeated 
calculations of optimum feedback matrices , currently offers the only general 
approach to this question. 

Finally, there is the dilemma of choosing between a design based on a 
"model in the system" (real model) and the so-called "model in the performance 
index" (implicit model). From the standpoint of mechanization, the essential 
difference between these two designs is that the former requires real-time 
comparison of model states and plant output, implying simulation of the model 
within the system, whereas the latter does not. But the relative merits of 
these two design approaches are not entirely clarified in the literature, 
although Tyler (ref. 2) has shed some light on this question. 

Mainly, this paper concerns the development of a sequence of algebraic 
tests applicable to both implicit and real model following for checking 
whether a plant can follow a model without error. The first test of the 
sequence answers the question of whether there exists a finite control func- 
tion for perfect following of a given plant and model. Failure of this test 
leads to the application of the second test in the sequence, which establishes 
if perfect following is possible when both finite and delta function controls 
are permitted, or to the termination of the testing procedure and the 
conclusion that no controls, neither finite nor delta functions, can achieve 


2 


perfect following. If perfect following is not achieved at the end of the 
second test, the same two options as at the end of the first test reoccur. 

That is, failure of the second test uniquely leads either to a third test 
enlarged to include derivatives of delta functions or to termination of the 
testing sequence. In the most general case, the testing may continue until 
n-2 derivatives of delta functions have been included, where n is the order 
of the plant. The control law that achieves perfect following of model and 
plant is obtained as a by-product of these tests for implicit model following. 

Finally, the greater understanding of the model -following theory, exem- 
plified, in particular, by the conditions for perfect following being identical 
for both implicit and real model following, leads to a rational criterion for 
choosing between the two design alternatives. 

Conditions for perfect following are also derived for real model following 
with command inputs to the model. Two conditions for perfect following are 
obtained, the first is the same as before and the second is unique to this 
c onf igurat ion . 

The paper concludes with the discussion of three examples. The first, 
based on the lateral equations of motion of an aircraft, compares the perfor- 
mance of implicit and real model -following designs under various operating 
conditions. The second and third examples were chosen primarily to illustrate 
the theory when unbounded controls are required for perfect matching. 


SYMBOLS 

Capital letters such as F, B, H denote matrices whose dimensions are 
defined in the text. The exceptions to this rule are 

I unity matrix 

J loss function 

K gain constant defined in the text 

Small letters denote state, output, or control variables. 

A f transpose of A 

A^ pseudoinverse of A (also known as generalized inverse) 

L" 1 inverse Laplace transform 

jr(a) null space of A 

S^A) 1 perpendicular complement of 91(A) 

R(A) range of matrix A 
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k(a) x 

y 


S(t-r) 

6 j(t-r) 
y a a 

v n ft 


perpendicular complement of ft(A) 

identical with pj 
dt 

either a small number or the logical statement "is a member of," 
depending on context 

delta function at t = r 

(j-l)th derivative of delta function 

set 1 is contained in set ft 

logical intersection of sets I and ft 


IMPLICIT MODEL FOLLOWING 


In implicit model following, the output dynamics of the plant are modified 
"by means of feedback to approximate the dynamics of a given model. Instead of 
m ini m izing the error between plant output and model states directly, implicit 
model following imposes a somewhat weaker condition which is stated in mathe- 
matical terms as follows. Let the multivariable plant be described by 


x = Fx + Bu (l) 

y = Bx (2) 


where x is an n-dimensional state vector, u an m-dimensional control vec- 
tor, and y an Z-dimensional output vector. The matrices F, B, and H do 
not depend on time and have dimensions nXn, nXm, and ZXn, respectively. Also, 
it is assumed that n s m and n a Z. The mathematical description of the 
model is taken to be 


z = Lz 

L = ZXZ constant matrix 


(3) 


where z denotes the Z-dimensional state vector of the model. The objective 
of implicit model following is to find a feedback law u = Sx to be placed 
around the plant so that the output y approximates 


y = Ly (4) 

as closely as possible over some specified time Interval. One technique for 
achieving this objective is to use optimal control to calculate the control 
law that minimizes the following quadratic loss function (refs. 3 and 4): 
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J = 


/ t(y - Ly) f Q(y - Ly) + u'Ru]dt 


where Q is a positive semidefinite and R, a positive definite matrix. This 
formulation of model following does not introduce the state variables of the 
model directly, since y and y appearing in the loss function can be expressed 
by means of equations (l) and (2) in terms of x and u alone. Hence, the 
terms "implicit model," "model in the performance index" (ref. 2), and "match- 
ing dynamics" (ref. 5) have all been used to describe this method. Figure 1 
illustrates the absence of dynamic coupling between model states and the 
closed -loop plant characteristic of this configuration. 



Figure 1.- Implicit model following. 

requiring that equation (4) be a strict 


We now address ourselves to 
the main problem of this paper, 
namely, that of determining under 
what conditions plant and model 
can be matched exactly. In 
essence, this problem Is equivalent 
y to determining whether or not the 
elements of the feedback matrix S 
offer the designer enough freedom 
of choice so that he can force the 
output of the closed -loop plant to 
satisfy equation (4) exactly. 

This question suggests that alge- 
braic methods might provide a con- 
venient framework for its solution. 
Using equations (l) and (2) and 
equality permits us to write 


HBu = (LH - HF)x (5) 

If a control u corresponding to any x in the state space is to exist so 
that equation ( 5 ) is satisfied, then the range of HB must contain the range 
of (LH - HF): 


ft(HB) => ft(LH - HF) (6) 

To derive an algebraic condition equivalent to condition (6), equation ( 5 ) is 
formally solved for u by taking the pseudoinverse of HB (ref. 6): 

u = (HB) + (LH - HF)x ( 7 ) 

Then, after u is eliminated from equations ( 5 ) and (7)* the condition for 
perfect matching becomes 

[(HB)(HB) + - I](LH - HF)x =0 all x (8) 

To justify the use of the pseudoinverse, one must show that if equation (8) is 
true for all x, that is, [(HB)(HB)t - I](LH - HF) is the zero transformation, 
then condition (6) is a necessary consequence. A property of the pseudoinverse 
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that permits this conclusion is the fact that (HB)(HB)^ is an orthogonal pro- 
jection operator on ft(HB). For the proof, let z he any vector in 
ft(liH - HF) and write it as the sum 

z = Zq + z x 


where 


z 0 eft(HB) and Zx £ ft(HB) X 

Since [(HB)(HB) t - I] is also an orthogonal projection that projects every 
z£R(LH - HF) on ft(HB) 1 and since, by assumption, equation (8) is zero for 
every x, it follows that 

z = z 0 

and, therefore, r(LH - HF) c R(HB). Thus, we conclude that choosing 

u = (HB) f (LH - HF)x (9) 

•when 

[(HB)(HB) f - I] (LH - HF) = 0 (10) 

guarantees that y = Ly, or, equivalently, that the output dynamics of the 
closed -loop system will match the desired output dynamics. Furthermore, the 
boundedness of the pseudoinverse implies that the feedback law (HB)^(LH - HF) 
is bounded. Therefore, if the condition for zero error (eq. (10)) is 
satisfied and the model is stable, the controls that achieve a perfect match 
are always bounded. 

This proves the sufficiency of equation (10) for perfect matching with 
bounded controls. The necessity of this equation follows from a similar argu- 
ment. For if equation (10) is not the zero transformation, then any x such 
that 

[(HB)(HB) 1 ' - I](LH - HF)x i 0 

must necessarily yield a z = z 0 + z x where z x / 0. Since this z x is not 
within the range of HB, it follows that no u exists which can satisfy 
equation (5) for that particular choice of x. 

When equation (10) is not satisfied, it may still be possible to achieve 
zero error by enlarging the class of controls to include delta functions. As 
the next step, the control law and test for perfect matching derived above is 
extended to the case of unbounded controls. One begins by writing every 
control as a direct sum of ordinary and delta (impulse) functions: 
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( 11 ) 


u(t,-r) = ui(t) + ug(r)6(t - t) 
uiegi(HB)- 1 - 
u s e9l(HB) 

where 21 denotes null space, i the perpendicular complement, t a running 
variable, and t current time assumed to he fixed. Thus, the delta function 
occurs at time t. The strength of the delta function, u$, is restricted to 
lie in the null space of HB; otherwise the left side of equation ( 5 ) would 
contain an impulse of strength HBus while the right side would not. Hence, 
perfect matching would be absent at the moment the impulse occurred. 

It is shown in appendix A that at time t + , a moment after the impulse 
has occurred, the derivative of the output y(t + ) is as follows: 

y(t + ) = HFx + HBui(t) + HFBu§ ( t ) (12) 

Our objective is to make the right side of equation (12) equal to LHx(t) by 
appropriately choosing ui(t) and u 5 (t): 

HBui(t) + HEBu 6 (t) = (LH - KF)x(t) (13) 

Before equation ( 13 ) can be solved explicitly for the control functions, it is 
necessary to introduce an auxiliary variable u = ui + u§ and write ui and 
ug, by means of the pseudoinverse , as projections of u on 9t(HB)' L and 3t(HB), 
respectively: 

Ui = (HB) + (HB)u , U6 = [I - (HB) t HB]u (l4) 

Then, after substituting equations (l4) into equation ( 13 ), one may solve 
explicitly for u: 

u = M?(LH - HF)x ( 15 ) 


where 


M = HB + HFB[I - (HB) t HB] 

Finally, the condition for perfect matching can now* be derived by replacing 
ui and U 5 in equation ( 13 ) vith the relationship for these quantities 
obtained from equations (l4) and (15): 

(MM + - I)(LH - HP) = 0 ( 16 ) 

If condition (l6) is satisfied , then equation ( 15 ) essentially gives the 
control law that achieves perfect matching, except that the problem of gener- 
ating a delta function control has not yet been considered. Assuming for the 
moment that it is possible to generate the required delta function, we want to 
demonstrate that from time t+ onward the equality of equation (4) can be 
maintained. In general, equation (4) or ( 5 ) will not be equal at time t 
since the effect of the delta function is not felt -until time t + , an 
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infinitesimal instant later than t. At that moment a step change occurs in 
y in such a way that equation (4) becomes an equality. Perfect matching is 
therefore assured for at least a time interval that is short in comparison to 
the fastest time constants of the system. As soon as the difference between 
y and Ly exceeds some small threshold, where the value of the threshold may 
be chosen arbitrarily small, another impulse whose weight is chosen according 
to equations (l4) and (15) is applied. The second impulse reestablishes the 
equality of equation (4). Clearly, perfect matching can thus be maintained 
indefinitely by applying impulses whenever the threshold value is exceeded. 

We also note that the smaller the threshold value, the closer will be the 
spacing of the impulses, but also the smaller will be the strength of the 
impulses . 

The problem of implementing a closed-loop control law that generates the 
required delta functions is discussed in appendix B where it is shown that an 
approximate synthesis of such a control law is obtained by multiplying u§ by 
a large positive gain constant K and that the approximation to the ideal 
delta function control law improves in proportion to the magnitude of K. 

If equation (l6) is not satisfied and the rank of M is not maximal, it 
may still be possible to achieve perfect matching by including derivatives of 
delta functions in addition to the previously used controls. The derivation 
in this case will be indicated only briefly since the arguments remain essen- 
tially the same as before. The control u is now written as the sum of three 
controls : 

U = Ui + UgS(t - r) + Ugi(t - t) 
uie[!Jl(HB)]- L 
u 8 e9t(HB) n [ !Jt( HUB ) ] X 
u S i€!Ji(HB) n SR(HFB) 

This decomposition insures that delta functions and their derivatives do not 
appear in the expression for y, which becomes, according to appendix A, 

y = HFx + HBui + HFBug + HF^BUgi (17) 

At this point, the right side of y is equated to LHx and the condition is 
found that describes when the resulting equation has a solution u for all x 
in the state space. Fundamentally, the procedure for deriving this condition 
is similar to the previously treated case of finite and delta function con- 
trols. One begins by defining u = ui + u & + ugi and then writing the three 
components of u as orthogonal projections of u on the appropriate 
sub spaces : 

Ui = Piu , Ug = PgU , Ugl = PglU (18) 

whereupon equations (l8) are used to write equation (17) in terms of u alone. 
From that point the derivation is exactly the same as before, and the condi- 
tion for perfect matching can again be put in the form given by equation (l6), 
except that M must be taken as M = HB + HFBPg + HE^BPgi . For general 
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vector controls, the construction of the projections may he computationally 
somewhat lengthier than before, hut for scalar controls explicit formulas can 
still he given: 

Pi = (HB) t HB , P 8 = [I - (HB^HB] , P 51 = [I - (HB) + HB][l - (KFB) + HEB] 

It may he verified that for this special case of scalar controls, at most one 
of the three projections is nonzero. If all three are zero, one may proceed 
to higher order delta functions hy obvious extensions of the theory. In the 
general case of vector controls, the end of the testing sequence is reached 
either when the (n-2)th derivative of delta functions is included or when the 
intersection of the null spaces 9t(HB), !Jl(HFB), . . . , 3l(HFJB) becomes empty 
for some j £ n-2. 


REAL MODEL FOLLOWING 


In the implicit model -following design, only the model parameters were 
considered in the selection of the feedback matrix; the model states them- 
selves were not needed. In real model following, the model states must he 
generated because here we ask for a feedback law S and a feedforward law A 
so that the response of the closed-loop system x = Fx + BSx + BAz is such 
that y(t) & z(t) rather than y ^ Ly as for implicit model following. Fig- 
ure 2 with u c = 0 is a block diagram for this model -following configuration. 


u 


c 



Feedback 
matrix S 


Figure 2 . - Real model following . 


For general multivariable systems, optimal control theory again offers the 
most efficient method of calculating the appropriate feedback and feedforward 
matrices. A convenient choice for the loss function is 


J = 



z) + u'Rujdt 


(19) 


It is customary to reduce equation (19) to standard form by augmenting the 
state equations of the plant with those of the model, thus forming the 
augmented state equation: 


w = 



w 
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where 


v = 



Then one minimizes the completely equivalent loss function 


where 



( 20 ) 


It has been shown that the feedback matrix which minimizes J of equation ( 19 ) 
depends only on F, Q, and R and not on the model parameter L, whereas the 
optimum feedforward matrix depends on both model and plant parameters (ref. 2). 


On first sight, it might appear that having the model in the system and 
using the states of the model in real time to control the plant through the 
feedforward loop would greatly add to the power of the method in comparison to 
implicit model following. Yet the two methods are equivalent in a certain 
sense, as will now be demonstrated. 

After this brief introduction to real model following, we now proceed 
with the problem of deriving conditions for perfect following of plant and 
model when the criterion is equality of y(t) and z(t) for all t. The deri- 
vation uses the fact that if all orders of time derivatives of y and z are 
equal at time t = 0, then the error will be zero for all time. Beginning 
with the zeroth derivative , one obtains 

z(t) = Etx(t) (21) 


at t = 0. This is merely an initial alinement condition of model and plant 
states that can always be satisfied at the start of the control period. Next, 
both sides of equation (2l) are differentiated and then rewritten with the 
help of equations (l), (2), (3)^ and (2l) as 

H(Fx + Bu + BAz) = H(Fx + Bu + BAHx) = LHx (22) 

Here Az represents the feedforward control, but the explicit dependency of 
this control on the model states z has been eliminated in the middle member 
of equation (22) by use of equation (2l). Solving the last two members of 
equation (22) for u, one obtains 

u = (HB)+(LH - HF - HBAH)x (23) 


The condition for equality of the first derivative is found by eliminating u 
between equation (23) and the last two members of equation (22): 
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[(HB)(HB)t - I] (LH - HP) = 0 


(24) 


where the two terms arising from the feedforward control canceled hy virtue of 
the identity (HB) (HB)t(HB) = HB (ref. 6). But equation (24) , if true, holds 
for arbitrary t; therefore, all higher order derivatives of the error will 
also he zero. If condition (24) is not satisfied and HB does not have maxi- 
mal rank, we can attempt to achieve perfect following hy enlarging the class 
of admissible controls to include various orders of delta functions. But the 
procedure for doing this differs in no way from that for implicit model fol- 
lowing and, moreover, yields identical results. Thus, the conditions for per- 
fect dynamic matching are in every respect the same as for implicit model 
following. Direct use of the model states in the feedforward loop neither 
adds to nor subtracts from these conditions. 


Real Model Following With Command Inputs 

In some applications, the model receives command inputs from an external 
source, such as a human operator. This is called "flying the model" and is 
illustrated in figure 2. It is easy to extend the theory derived in the 
preceding section to such a situation. The equation for the model is 

z = Lz + Bu c ( 25 ) 

where u c is the command input. The plant, the output equation, and the 
objective, equation (2l), remain as in real model following. Then, for per- 
fect dynamic matching the alinement condition must he satisfied as before: 

Hx(t) = z(t) 

The control law for dynamic matching is obtained by requiring that the first 
derivative of y and z be equal: 

u(t) = (HB) + (LH - HF)x(t) + ( HB ) + Bu c ( t ) (26) 

The feedforward control Az has been omitted from equation ( 26 ) since it was 
previously shown to be irrelevant. The first derivatives of y and z will be 
equal for all x and u c if 

[(HB)(HB) + - I] (LH - HF)x = [(HB)(HB) t - l]Bu c ( 27 ) 

Since u c is independent of x, each side of equation ( 27 ) must be zero 
separately: 


[(HB)(HB) t - I] (EH - HP) = 0 

[(HB)(HB) t - I]B = 0 

Equations (28) give the conditions for dynamic matching with command inputs to 
the model. Here the second of equations (28) introduces a genuinely new 
condition. Again the theory can be extended as needed to include delta 
function controls. 
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EVALUATION OF REAL AND IMPLICIT MODEL FOLLOWING 


It has been shown that the conditions for perfect matching and the control 
law which achieves perfect matching are identical for both real and implicit 
model following. Thus, if it is assumed that perfect matching is possible 
with either bounded or unbounded controls and that unknown disturbances are 
absent, there is no essential advantage of one design over the other. The key 
issue in deciding between a real model -following design (with its additional 
hardware requirements) and the simpler implicit model following is whether or 
not the requirements of the problem dictate that a particular phase trajectory 
of the model be followed in the presence of unknown disturbances in the plant. 
Implicit model following is not capable of following a phase trajectory of the 
model where disturbances are present since no real-time error measurement 
between model and plant states takes place; the model following is open loop 
as it were. But, if the model serves merely to characterize the desired 
dynamic properties of the plant, in other words, if model and plant have sim- 
ilar responses when starting at the same initial states with no disturbances 
present, the implicit model following would be sufficient. 

Maintaining alinement between plant and model in the presence of uncer- 
tainties, be they unknown parameters or random disturbances, necessitates the 
use of a real model in the system. With a model in the system, errors arising 
between model and plant states due to uncertainties can be measured and cor- 
rected continuously. Thus, the principal advantage of having a model in the 
system is not that it always achieves better following, but that it 
desensitizes the following to unknown disturbances. 

For real model following, the control law given by equation (23) cannot 
be used by itself since it does not include the states of the model; that is , 
this control provides dynamic matching only and does not attempt to realine 
the plant and the model states if disturbances cause them to drift apart. 

Here the techniques of optimal control would seem most appropriate for 
computing the control law. 


EXAMPLES 


In this section three examples are presented. The first represents the 
linearized lateral equations of motion of an aircraft. Three model -following 
designs, one calculated by the theory developed in this paper and the other 
two by the methods of quadratic optimal control, are compared, and the advan- 
tages of each are pointed out. The second and third examples illustrate the 
theory when unbounded control laws are required for perfect matching. All 
computations were performed with the automatic synthesis program of Kalman and 
Englar (ref. 5 )* 
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Example 1 


The numerical values for hoth plant and model parameters were taken from 
one of Tyler f s examples (ref. 2). The plant actually describes the lateral 
dynamics of the B-26 airplane which was used as a test bed for model -following 
studies at Cornell Aeronautical Laboratory, whereas the model corresponds to 
the lateral dynamics of some other airplane whose handling characteristics are 
to be simulated on the B-26. 


F = 


L = 


B = 


0 

1.0 

0 

0 


0 

- 2.93 

- 4.75 

- 0.78 


0.086 

0 

-0.11 

-1.0 


0 

-0.0^2 

2.59 

-0.39_ 


~0 

1 

0 

0 

1 

0 

-1 

- 73 . 1 ^ 

3.18 

0.086 

0 

-0.11 

-1 


0.0086 

0.086 

8.95 

- 0.49 


0 0 
0 -3.91 


0.035 0 

-2.53 0.31 
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<P 

State vector - 

3 

r 


(bank angle) 
(bank rate) 
(sideslip angle) 
(yaw rate) 


Control vector = 



(rudder deflection) 
(aileron deflection) 


H = I 
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The test of perfect 

matching (eq. (8)) applied to this 

example gives 




“0 

0 

0 

0 ~ 

[(HB)(HB) t - I] (LH 

- HF) = 

-1.3X10" 7 

-1.2X10" 4 

-4.3X10 -6 
-3. 9x10 _3 

-1.1X10” 5 

-1.3X10" 2 

-3. 4xio “ 6 
-3- 0x10 “ 3 



-1.6X10 -6 

-5 • 4xio “ 5 

-1.8X10 -4 

-4.0X10 -5 


(29) 


Thus, perfect matching is not possible because the right side of equation (29) 
is not the zero transformation. Since HB has maximum rank, it also follows 
from earlier work that delta function controls cannot improve this situation. 
Nevertheless, because most entries in the matrix of equation (29) are small 
compared with entries in the system and model matrices, it is interesting to 
compare the performance of the simple model-following control law, 
equation (l) , 


u 


(hb) + (lh - kf)x = 


-3. 4X10 “ 3 
0 


-0.11 -0.37 

-0.49 17.5 


-o.osn 


- 1.01 


X 


(30) 


with those calculated by optimal control for both the implicit and real model- 
following performance indices. For the implicit model -following case the 
diagonal weight matrices Q and R selected for this calculation correspond to 
those used by Tyler and appear to give a reasonable compromise in matching all 
the state variables. The Q and R matrices entering into the real model- 
following performance index were selected experimentally to give good follow- 
ing of all model states. The numerical values for the Q, R, feedback, and 
feedforward matrices corresponding to the two optimal control designs are 
given below. 


Implicit model following 

Diagonal Q 

Feedback matrix = 


[0,6, 0,6] Diagonal R = [1,1] 

0.0034 0.111 0.371 0.0356"" 

0 0.494 -17.5 0.6l4 


Real model following 

Diagonal Q = [10,10,10,10] Diagonal R = [1,1] 


Feedback matrix 


-0.074 

-3.15 


-0.094 2.34 

-2.73 0.835 


-3.23 

0.261 
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-0.246 2.109 

-3.16 16.6 



Figures 3 and 4 compare the transient responses of the three different 
control lavs for two initial conditions corresponding to an initial hank angle 
and an initial bank rate, but with the model and plant states alined at the 
start. Because the response of the implicit model -f oil oving lav calculated 
vith optimal control vas generally not much different from the response 
obtained vith the control lav of equation ( 30 ), it is not dravn on all the 
figures in order to reduce crovding of the curves. Also, those state variable 
time histories not included vere found to be as veil matched as cp in fig- 
ure 3(a) . It can be seen in figures 3 and 4 that at least during the first 
5 seconds, the control lav of equation ( 30 ) performs as veil as the real 
model-folloving design or better. This is particularly evident in the 
responses of figures 3(h), 3(c), and 4(b), vhere the real model-folloving 
design often shovs considerable error betveen model and plant. Experimenta- 
tion vith the Q matrix did not measurably improve the matching. A probable 
explanation of vhy the control lav of equation ( 30 ) achieves better matching 
of the transient response is suggested by the fact that optimal control 
minimizes the square of the error over the entire control interval, vhich in 



time, sec time, sec 

Figure 3-- Transient responses pertaining to Figure 4.- Transient responses perta ining to 

example 1: initial "bank angle disturbances. example 1: initial roll rate disturbance. 
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this case was essentially infinite. This would put primary emphasis on the 
steady-state portion of the response and would deemphasize matching of the 
transient response. The opposite is true of control law (30) which essen- 
tially tries to minimize the norm of the error between time derivatives of 
model and plant states at any given moment. This is due to a property of the 
pseudoinverse (ref. 6). When model and plant are not too dissimilar , as shown 
in this case by the results of the perfect following test (eq. (29)), one can 
expect this procedure to work quite well; but for a greatly mismatched model 
and plant, again as determined by the perfect following test, no assurance of 
satisfactory operation can be given. This line of reasoning also explains why 
the response of control law ( 30) approximates the implicit model -following 
response obtained by optimal control, because both attempt to match the 
derivatives of model and system states, although the latter does so over an 
infinite time interval. 




Figure 5*" The effect of initial hank misaline- 
ment between model and plant in real model 
following with optimal control design. 


Slight discrepancies between the 
transient responses of the real model- 
following design calculated by Tyler 
(ref. 2) and those calculated in this 
paper have been observed. The origin of 
the discrepancies has not been definitely 
established, but it probably lies in 
small differences between the parameters 
used in the two studies. 

Figures 5(a) and 5(h) demonstrate 
when it is advantageous to use real model 
following. Here a disturbance in the 
plant is assumed to have caused a sudden 
misalinement between the model and plant 
bank-angle variables. Under this condi- 
tion, the real-time error measurement 
between model and plant, which is possi- 
ble only with real model following, 
facilitates the eventual realinement of 


corresponding state variables. Thus, the model serves as a memory of a 
particular trajectory in the presence of disturbances. 


Example 2 

A simple example is chosen deliberately so that the required computation 
can be performed by hand. The plant, output, and model parameters are 



0 

1 


0 

F = 

0 

0 

B = 

1 


L 

J 



H = 

[1 

0] 

L = 

-5 
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Since HB = 0 ; ve conclude that finite controls will not be sufficient to 
achieve perfect matching. But the perfect matching test based on the use of 
delta function controls, equation (l6), can be successful. Then, according to 
appendix B, the control law that achieves perfect matching asymptotically as 
K approaches infinity is 


xi 

U = K[-5 -1] 

x 2 

A block diagram of the closed -loop system is shown in figure 6. 



Example 3 

The open-loop plant equations of this example are fourth order and differ 


only slightly from those of example 1. 
which is only second order: 


0 

1.0 

0 

0 

-2.93 

-4.75 

0.085 

0 

-0.11 

0 

-0.042 

2.59 

0 1 
0 0 

0 0 
1 0 



The main difference lies in the model 


0 


"0 

o~ 

0 

B = 

1 

1 

-1.0 


0 

0 

-o.39_ 


0 

1 


L = 

0 

-2 
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Thus , the objective in this case is to make the essentially fourth-order plant 
look like a simple second-order system through the appropriate use of feedback, 

model It can be shown that the test for perfect follow- 

K - 5 ing with finite controls (eq. (lO)) applied to 

k * lo this example fails; therefore it is necessary to 

k * 20 use the more general test given by equation (l6), 

which considers sums of finite and delta func- 
tion controls- This latter test shows that per- 
fect following is indeed possible with a control 
law containing both finite and delta function 
controls • 


After the required calculations are per- 
formed, the two parts of the control law are 




Ui = 


0 


0 


1.465 

1.465 


= 


-0.086 

0.086 


-2 


2.875 

2.875 

-1.89 

1.89 


0 


X 


X 


As shown in appendix B, an approximate syn- 
thesis of a control law containing delta func- 
tions is obtained by multiplying u^ by a large 
positive constant K. The total control is then 
given by the sum of the two components, with K 
appearing as a parameter in the feedback matrix: 


u 


-0.086k 

0.086k 


1.465-2K 

1 . 465 + 2 K 


2.875-I.89K K 
2.875+I.89K -K 


X 


Figure 7.- The effect of K on the 
transient response of example 3* 


Figures 7(a) and 7(h) demonstrate the con- 
vergence properties of the control law as a 
function of the gain constant K. 


CONCLUSIONS 


Two basic approaches, each having its particular advantages and disadvan- 
tages, exist for designing a model-following control system. In the implicit 
model -following method, the model enters only into the selection of the feed- 
back law placed around the plant but does not become physically part of the 
total system. Thus, feedback is used to modify the dynamics of the plant so 
that its output behavior coincides with that of the model. This type of fol- 
lowing therefore operates open loop with respect to the model since during the 
control interval no real-time comparison of model states and plant output 
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takes place. The main advantages of this method are simplicity and low cost 
of implementation because simulation of the model in the system is not 
necessary. 

If design specifications require that the model -following control system 
he able to follow a specific phase trajectory of the model starting at a given 
initial state while the plant is subject to unknown disturbances or parameter 
changes, then real model following is the appropriate choice. Here the contin- 
uous measurement of error between model states and plant output offers the 
additional freedom of using this error, appropriately weighted, as a means of 
alining the model and the plant. However, because the conditions for perfect 
following are identical for both real and implicit model following, this addi- 
tional freedom does not contribute to improved matching of the dynamics of 
model and plant in comparison with implicit model following. 

Although optimal control theory offers the most general method available 
for the design of model-following systems, it is inefficient, because of the 
computational effort required, for answering such preliminary design questions 
as whether or not it is possible to match model and plant dynamics and, if so, 
whether bounded or unbounded controls are required. The theory presented here 
answers such questions directly by means of an algebraic test and, in addition, 
furnishes, for implicit model following, a simply computed control law that 
achieves perfect matching if known to be possible by the test. It is demon- 
strated that even if perfect matching is not possible the performance of a 
system using the simple control law may compare favorably with the performance 
of systems designed via optimal control so long as the dynamics of model and 
plant are not too dissimilar. 


Ames Research Center 

Rational Aeronautics and Space Administration 

Moffett Field , Calif. 9 ^ 035 , April 11 , 1968 
125 -19 - 04 -08 -00-21 
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APPENDIX A 


CALCULATION OF OUTPUT DERIVATIVE FOR INPUTS 
CONTAINING DELTA FUNCTIONS 


The purpose of this appendix is to derive expressions for the derivative 
of the output, y(t), when the controls applied to the system contain various 
orders of delta functions. For reasons discussed in the main body of this 
report, not every possible combination of finite and delta function controls 
need be considered here; rather, it is sufficient to let the control u(t) be 
of the form 


u( t , T ) = Ui(t) + Ug5(t - r) + u 61 S(t - t) + 

where 

Uierfl(HB) 


+ u .n-2 &n " 2 ( t ‘ T ) 


(Al) 


u Q e^(HB) D ^(HFB) 1 

t. em(HB) n t(heb) n dKbf ^) 1 

O-L 


Ugn-a^HB) fl • • • fl ^(HF 11 "^) H ^HE^"^) 1 

If, for the moment, one considers an arbitrary delta function 

Ug ( t , t ) = S(t - T)ug(r) and a bounded control ui(t), then y(t) is written 

y(t) = H[Fx(t) + Bui(t) + Bu^Ct )&( t - t)] (A2) 

We are interested in calculating y(t + ) where t + designates, as is customary, 
a time constant infinitesimally later than t. It will now be shown that 
y(t + ) has the form 

y(t + ) = H^F[x(t) + Bug ( t ) ] + BUi(t)j- (A3) 

assuming Ui(t) and U 5 (t) are continuous functions of t. To prove this fact, 
sketch (a) assumes that the jth state variable xj receives u§(r)8(t - t) 
through the distribution matrix B, whose components are designated by b jic - 
The action of the delta function causes the output^of the jth integrator at 
time t + to take the value xj(t + ) = xj(t) + Fb jk u kg ( t ) • Similar reasoning 
must be applied to the output of the remaining integrators, thus yielding 
x = x + Bu§. This updated state vector x was used in deriving equation (A3). 
Finally, the condition that u(t) = uq(t) egi(HB) reduces equation (A2) to 

y(t) = HFx(t) + HBui(t) (A4) 
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Sbjk'ukg (t) 8( t -r ) 
k = I 



► 



F = [»H 1 


Sketch (a). 

that is, the impulse at time t causes a step change in the derivative of 
hut the impulse itself has heen prevented from appearing in y. 

If y is of the general form given by equation (Al), it is easy to 
demonstrate that equation (A3) generalizes to 


y(t + ) = H[f!x(t ) + Bui(t) + EBu^(t) + . . 


. + /'Vgn.sCt)] 
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APPENDIX B 

APPROXIMATE SYNTHESIS OF FEEDBACK LAW 
CONTAINING DELTA FUNCTIONS 


In the derivation of conditions for perfect following, it was necessary 
to include delta functions as permissible controls in order to achieve perfect 
following. Whenever the model is of lower order than the plant, it may he 
expeditious to sacrifice a part of the plant dynamics for better matching, and 
in that case delta function controls are necessary. Important questions arise 
now as to the procedure for constructing a control law containing delta func- 
tions and how to approximate one to arbitrary accuracy. Although the concept 
behind the construction of such a control law is well known, its adaptation to 
this problem requires some explanation. The procedure involved will be 
illustrated on a controllable plant with scalar control. 

Assume now that the perfect matching test developed earlier has been per- 
formed and that the required control law for perfect matching is 

u = (HFB^LH - HF)8(t - t)x (Bl) 

Equation (ll) always reduces to equation (Bl) if u is a scalar. The princi- 
pal conclusion of this appendix is that the control law given by equation (Bl) 
can be approximated to arbitrary accuracy in a given time interval 0 < t ^ T 
by + 

u - K(HFB) t (LH - HF)x (B2) 

where the positive constant K is chosen sufficiently large. 

For the proof, let u(s) be a rational function of s with the denomina- 
tor at least one degree higher than the numerator, and consider the output 
x n (t) of the system shown in sketch (b) . Then one can show that the output 
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p 


x n (t) of this system can "be expressed as 

x n (t) = L -1 u(s) + XnCoJe"^" 8,11 ^ + Ku( -K + anJe - ^ -8-11 ^ 

where Rj xs the residue of the jth pole of u(s). 

A word of explanation on deriving equation (B3) is 
with x n (t) obtained by standard transform methods: 


+ 




R j( s j ~ a n) 
s j + K - a n 



(B3) 


in order. One starts 


x n ( *fc ) 



x n(°) + L -i u(s)K 

+ K - a n s + K - a n 


Then follows the crucial step of adding and subtracting L" 1 u(s) to the right- 
hand side of the equation, whereupon routine algebraic manipulations yield the 
form of x n (t) given in equation (B3) • The purpose of writing x n (t) in this 
way is to find an explicit expression for the error as a function of K 
between the desired time response L“ 1 u(s) and the actual time response, X n (t), 
with the ultimate objective of showing that this error approaches zero as K 
becomes infinite. With respect to equation (B3)> this error, denoted by e 
and consisting of all the terms on the right-hand side except the first one, 
is seen to approach zero as K becomes infinite. That is, in any given time 
interval 0 < t ^ T, the gain constant K can be chosen so large that 

x n (t) = L” 1 u( s) + € (b4) 


and € is arbitrarily small. 

To relate this result to the case at hand, one must show that the closed- 
loop system 


x = Fx + BK(HEB)t(LH - KF)x 


(B5) 


has embedded within it subsystems of the type shown in sketch (b) at every 
integrator to which B distributes the control u. This is demonstrated by 
the phase variable form of the open-loop plant given below (ref. 7): 


x 


0 

1 

0 

• 

• 

• 



0 

Xi 


0 

0 

0 

1 

0 

• 

• 

• 

• 

0 

» 


0 

• 









• 

+ 

• 

• 









0 


• 

• 

0 

0 

• 

• 

• 



0 

1 

0 

# 


0 

ai 


• 

• 

• 

■ 



a n 

x n 


1 

_ 


(B6) 
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In the basis which yields the above representation of the plant , the matrix H 
must have the form 

Phil ki2 * • • hin-i 0~J 


H = 


0 


(B7) 


hZi 


0 

hZ n 0 


since HB = 0 because delta function controls are required for perfect match- 
ing. Given equations (b 6) and (B7) j one computes for the gain matrix 

(HEB) + (LH - HP) = [ki, k 2 , ... , -1] (B8) 


The -1 in the last entry of the gain matrix assures that the feedback gain 
around the nth integrator is nonzero and negative. Hence , the flow diagram 
around the nth integrator is of the form shown in sketch (b). 

One final point must be considered. In the closed-loop case, the input, 
u(s), to the nth integrator itself depends on the gain K through the feed- 
back loop, while earlier u(s) was assumed to be independent of K. It is 
therefore necessary in the closed -loop case to be sure that the poles and 
residues of u(s) converge, to finite values as K approaches infinity and 
that the degree of the denominator of the limiting form of u(s) is greater 
than the degree of the numerator. Sketch (c) illustrates the problem for the 



Sketch (c).- Block diagram for computing u(s). 


assumed phase -variable form of the system. Straightforward computation shows 
u(s) has the form 

f. ( \ / \ f2( s ) /_ n \ 

u(s) = “£n — x n(s) + — (B9) 


2b 




where fi(s) and fa( s) are polynomials of at most (n-l)st degree. But x n (s) 
can also be written as a function of u(s): 


x n (s) 


Ku(s) + x n(°) 

s-a n +K s-a n + K 


(BIO) 


After x n (s) is eliminated between equations (B9) and (BIO) , u(s) 
into the form: 


1 f fi(s)x n (0) f a (s) 

fi(s)K |_s n (s - a n + K) + s n 
s n (s - a n + K) 


can he put 


(Bll) 


The limiting form of u(s) as K -* 00 therefore becomes 

\ _ ^g( s ) 

u ( s 'lim s n _ f 1 ( g ) 


(B12) 


In both equation (Bll ) , which holds for finite K, and equation (B12) the 
degree of the numerator is less than the degree of the denominator as required. 


ALTERNATE DISCUSSION OF APPROXIMATION FOR DELTA FUNCTION CONTROLS 


A disadvantage of the preceding discussion concerning approximation of 
delta function controls with large feedback gains is that it is difficult to 
generalize to vector controls or to higher order delta functions. An alter- 
nate approach that avoids this difficulty but necessitates the use of a piece- 
wise constant control is now presented. To begin with; it is assumed that 
perfect matching in the implicit model -following sense can be achieved with 
controls containing finite; delta function; and derivative of delta function 
components. These three components of u (eq. (l8)) are repeated here for 
convenience: 


Ui = PlU , Ug= PgU , u 81 = P 51 u (B13) 

where u is defined as 

u = M?(LH - HF)x = (HB + HFBP S + HF a BPg 1 ) t (LH - HF)x (Bl4) 

The next step is to divide time into equal increments At; which are 
chosen much shorter than the shortest time constant of the model and the plant. 
The control applied to the plant remains constant throughout each time incre- 
ment and is updated only at the beginning of a new increment. If the control 
process is assumed to start at t = 0; the first control applied to the plant 
is chosen as 


u(0) 


= _ p i + k 


■S (At) 2 5lJ 


M t (LH - HP)x(0) 


(B15) 
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We note t ha t the gain constants multiplying those components of control that 
require delta function and derivative of delta function are l/At and 2/ (At) 2 , 
respectively. Also, x(0) is arbitrary and therefore may be such that 
y(0) 4 Ly(0) . 


This sets the stage for the crucial step of this approach, namely, the 
computation of the error between y and Ly at the end of the first time incre- 
ment. Using the standard expression for the time response of a linear system 
(ref. 6), we compute y(At): 


y(At) = H e F ^x(o) + F T ^Bu(r)dT 

L 


(Bl6) 


where the transition matrix 


_Ffc 


is given in terms of the infinite series as 


Ft 

e 


I + Ft + 



(B17) 


Substituting equation (B17) Into (Bl6) and using the fact that u(t) is con 
stant within the integration interval yields 


y(At) = H-jx(o) + AtFx(O) + ^ F s x(0 ) + . . . 

2 1 1 • • • Bu( 0)j- 




(B18) 


The term y(At) is calculated to evaluate the error between y(At) and Ly(At) 
ami to show that it can be made arbitrarily small. The error, denoted by 
T](At), is evaluated using equations (l), (2), (B15)> and (Bl8): 


T)(At) = HsF + AtF 2 + 


At 2 ! 13 

2 \ 


FAt + 


F g At 2 

2 


F 3 At 3 

3! 


BPi + 


BP S 

At 


(At) 2. 


M t (LH - HF) + B 


Pi + XT + 


At 8 (At) 2 81 


M f (LH - HF)j- x(o) 


LH + AtLHF + LHF 2 + 


2 ! 


+ Umt + + ^ 




2 ! 
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BPi 


BP§ ^Si " 1 
+ At + (At)2j 


(LH - HF)j- x(0) 


(B19) 
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Since 


HBP^ - 0, HBP^ = and HFBP^ = 0, equation (B 19 ) simplifies to 

T](At) = (MM + - l)(LH - HF) + 0(At) (B20) 

where 0(At) are terms that go to zero at least as fast as At. But the first 
term is identically zero by the assumption that the perfect matching condition., 
equation (l6), is satisfied. Thus, if At is sufficiently small (or the gain 
constants arbitrarily large), the error at the end of At seconds can be made 
as small as desired for any initial condition. 

Furthermore, the error can be maintained arbitrarily small for all future 
time if the control, equation (B15), is updated at the beginning of each new 
time increment by replacing x(nAt) with x[(n + l)At] , n being the number of 
time increments. 

Needless to say, through appropriate limiting arguments, the discussion 
given here for a discrete time control law can be generalized to continuous 
time control. The mathematical details, however, are tedious and are not 
elaborated here. 
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